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INFORMATION DRIVEN ROUTING IN AD HOC SENSOR NETWORKS 

BACKGROUND OF THE INVENTION 
1- Field of Invention 

[0001] The systems and methods of the invention concern information 
directed routing in ad hoc sensor networks. 
2. Description of Related Art 

[0002] Routing in traditional communications networks is a well-studied 
problem in both patent and non-patent literature. Graph-based algorithms such as 
Dijkstra's or Bellman-Ford type algorithms are often used to determine optimal paths 
within a network with respect to metrics such as, for example, communication cost 
and delay. Of recent interest is the topic of routing with resource constraints. Energy 
aware network routing has been proposed in various places, such as, Shah et al., 
Proceedings of the IEEE Wireless Communications and Networking Conference 
(WCNC), March 17-21, 2002, Orlando, FL; and Aslam et al., Proceedings of the 
Seventh Annual International Conference on Mobile Computing and Networking 
(Mobicom), July 2001, Rome, Italy. More complicated constraints are incorporated 
into routing problems in U.S. Provisional Patent Application, Serial No. 60/373,916, 
entitled, " Systems and methods for constrained anisotropic diffusion routing with an 
ad hoc network, "by Haussecker, et al., and co-pending U.S. non-provisional Patent 
Application Serial No. 10/446,1 15, the disclosures of which are hereby incorporated 
by reference in their entirety. In Haussecker et al., the route destination is specified by 
a set of constraints, and the disclosed algorithm seeks efficient routes to the 
destination. 

[0003] Constrained anisotropic diffusion routing (CADR) is proposed in the 
target tracking applications of Haussecker et al. to route a query from a peripheral 
access point to high activity regions, using information gained enroute to guide the 
successor node selection. The information gained enroute is measured using 
variations of distance metric, assuming the sensors that are close by the target have 
more information about the target than those that are far away from the target. The 
optimization problem is greedy, that is, at each step, the current leader selects among 
its successors the best choice for the time being and hands over leadership to the best 
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choice. Due to its greedy nature, the selection is sub-optimal and often gets stuck at 
sensor holes where the sensor field is sparse. 

[0004] Network route selection for fixed centralized computer networks is 
described in a number of publications, including, for example, U.S. Patent No. 
6,321,271, which describes a method for finding the short routing path under some 
acceptable delay constraints. The method described by this patent employs a two 
stage process, using Dijkstra's algorithm at each phase. The algorithm is designed for 
wired high speed data communication networks, is centralized in nature, and requires 
complete knowledge of network topology in some central unit. 

[0005] U.S. Patent No. 6,078,963 describes a distributive router system. 
The focus of the disclosure of this patent is on the infra-structure. The router 
mechanism described by this patent is determined prior to the system setup. 

[0006] U.S. Patent No. 6,363,319 describes a method and apparatus for 
selecting a route for a flow from a plurality of network paths connecting a source to a 
destination. The accumulative cost is determined dynamically based on network 
characterizations such as flow attributes such as, for example, priority, bandwidth 
demand, etc., and path attributes, such as for example, available bandwidth. 

[0007] U.S. Patent No. 6,421,354 describes a system for providing data 
acquisition services for a customer from a sensor located in a remote location. The 
focus of the disclosure of the patent is on infra-structure. 

[0008] U.S. Provisional Patent Application, Serial No. 60/373,916, 
discussed above, describes a method that uses information gained in a greedy 
algorithm to select the next sensor. 

SUMMARY OF THE INVENTION 

[0009] An ad hoc sensor network is an emerging area in which technologies 
in traditional fields such as sensing, signal processing, estimation, and networking are 
integrated together. In many ad hoc sensor networks, sensor nodes can be considered 
as units with multiple functionalities such as sensing, data processing, information 
fusion, and network routing. To track or monitor some event of interest, these 
functionalities need to be properly combined. In principle, a routing problem in a 
sensor network is often coupled with information aggregation. For example, if a 
message containing information about the event of interest is to be transferred from 
one sensor node to another, one would like to not only find the path that is efficient in 
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terms of communication cost, for example, measured using a metric such as the 
number of transfers (hops), the energy needed to transmit the information, etc., but 
also to aggregate as much information as possible along the path, so that the user can 
have a good estimate/description about the event of interest at a destination node. In 
this sense, routing is not only a message-transporting mechanism, but also contributes 
to the successive refinement of the message. 

[0010] Various exemplary embodiments of the systems and methods 
according to this invention introduce the idea of information directed routing and 
sensor networks. Information aggregation is taken into account explicitly. Routing 
becomes a joint optimization problem whose solution results from the trade-off 
between two terms, that is, the routing cost that is incurred, and the information that 
can be gained by taking the path. This is in sharp contrast to the communication 
routing problem, where only the routing cost is of interest. 

[0011] According to the various exemplary embodiments of the systems and 
methods of this invention, the optimization based on information gained is 
intrinsically more complicated than typical network route selection problems, where 
only the shortest paths from the access node to the destination node are of interest. 
Various exemplary embodiments of the systems and methods according to this 
invention address problems such as how to measure the information gained at the 
sensor node, how to estimate the information gained that traversing through a path 
may bring, and how to find the optimal path. 

[0012] Various embodiments of the systems and methods according to this 
invention formulate the sensor network routing problem as a joint optimization 
problem taking into account routing cost and information aggregation. Information 
gain is used explicitly to optimize the routing path. With this joint optimization 
approach, the selected path is efficient in terms of communication metric, and also 
aggregates information about the event of interest. The optimization formulation 
breaks the barrier between network layer routing and application layer information 
aggregation/processing. 

[0013] According to the various embodiments of the systems and methods 
of this invention, for the case of stationary node states and additive information cost, 
the optimal optimization problem is reduced to the shortest path algorithm in a 
modified network graph. 
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[0014] Various exemplary embodiments of the systems and methods 
according to this invention route queries from an arbitrary entry point to high activity 
regions, e.g., regions in the vicinity of an event of interest, such as, for example, the 
location of a target, using inputs from sensor nodes along the path to refine the 
message. This can be considered as an extension of constrained anisotropic 
distribution routing (CADR) in terms of routing, and an extension of information- 
driven sensor querying (IDSQ) in terms of estimation. The multiple-step look-ahead 
approach of the various embodiments of the systems and methods according to this 
invention give better performance than the greedy CADR or IDSQ methods. With 
sufficient look-ahead horizon, the systems and methods according to this invention 
may avoid deadlocks and route around network sensor coverage holes. 

[0015] Various exemplary embodiments of the systems and methods 
according to this invention route queries between an arbitrary entry point and 
extraction point using an RTA*-type forward search algorithm. Various exemplary 
embodiments of the systems and methods according to this invention also estimate the 
future information gained along the path and select a successor node based on the 
estimate. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0016] Various exemplary embodiments of this invention will be described 
in detail with reference to the following figures, wherein: 

[0017] Fig. 1 is an exemplary embodiment of a route query to high activity 
network regions according to the systems and methods of the invention; 

[0018] Fig. 2 is an exemplary embodiment of point-to-point routing using 
forward search according to the systems and methods of this invention; 

[0019] Fig. 3 is a diagram of an exemplary heuristic used to estimate the 
information expected to be gained on the path from the current node to the exit node 
according to the systems and methods of the invention; 

[0020] Fig. 4 is a flowchart outlining an exemplary embodiment of 
information routing, according to this invention, to route a query from an arbitrary 
querier node to high-activity region to collect information; 

[0021] Fig. 5 is a flowchart outlining a point-to-point routing using a 
forward search according to an exemplary embodiment of the systems and methods of 
this invention; 
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[0022] Fig. 6 is a pictorial representation of a substantially homogeneous 
simulated sensor layout; 

[0023] Fig. 7 is a pictorial representation of a simulated sensor layout with a 
sensor hole; 

[0024] Fig. 8 is a pictorial representation of a simulated sensor layout having 
a query routing path produced by a greedy algorithm; 

[0025] Fig. 9 is a pictorial representation of a simulated sensor layout having 
a query routing path produced by a min-hop algorithm; 

[0026] Figs. 10 through 12 are pictorial representations of a routing query 
path toward a moving target produced by a min-hop algorithm at the end of 30, 60 and 
90 hops, respectively; 

[0027] Fig. 13 through 15 are pictorial representations of a routing query 
path toward a moving target produced by a greedy algorithm; and 

[0028] Figs. 16 through 18 are pictorial representations of a routing query 
path from a proxy to an exit node. 

DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS 

[0029] The invention describes a method to formulate the routing problem 
in ad hoc sensor networks, namely information-directed routing, which selects path 
which is both efficient in terms of communication cost but aggregates substantially 
information about the phenomenon of interest. One exemplary embodiment that 
involves a target estimation problem is tracking a target in a physical location 
domain, such as a two dimensional plane. Under the circumstances of this exemplary 
embodiment, it would be useful to transport a message and at the same time refine the 
target location estimate. This problem may be formulated as seeking a path in a 
network graph G= (V, E), where V are the collection of vertices, essentially the sensor 
nodes, and E are the edges, representing the connectivity in the network. The result 
path, denoted as (vy, v 2 , v T ), where vy, v 2 , v T are the vertices visited by the path 
in order, should be optimal in minimizing the total cost The total cost may be 
expressed by the following equation 1 : 



E = 5Xw ~rg(v,,v 2 , ...,v r ) 

i-l,...,7*-l 



(1) 
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[0030] The first term of Equation 1 is the summation of the costs {c ifi +j} 
associated with each individual edge of the aforementioned network sensor grid, 
measuring the communication expense of going from node i to node z+7. This cost is 
often expressed in terms of communication energy or delay. 

[0031] The second term in Equation 1 is the negative information gain - 
g(v!,v 2 , vr). This can be measured using metrics such as: 

• Variations of Euclidean distance. This metric is used for example in the 
incorporated Haussecker provisional application, and is normally 
considered to achieve good results if the sensor network is homogenous 
and consists of sensors whose quality of measurements decays 
monotonically with distance. 

• Mutual information. This statistics-based metric is used in an article by 
Liu et al., entitled "Collaborative in-network processing for target 
tracking," which appeared in EURASIP Journal on Applied Signal 
Processing, pp. 378-391, No. 4, March 2003 

• Norm of inverse covariance matrix. This is discussed in Durrant-Whyte et 
al., "Data fusion and sensor management: a decentralized information- 
theoretic approach," Prentice Hall, London, UK, 1993. This metric is easy 
to calculate, and can be regarded as a special case of the mutual 
information metric under the assumption that the sensor observational 
model and the target state dynamics are linear Gaussian. 

The regularization parameter y in Equation 1 , controls the balance between the 
two terms. In traditional communication network applications where shortest path is 
of interest, y is zero. In applications where the information gain is the primary 
concern, and high communication cost is affordable, y should be set some high value, 
for example, a multiple of (e.g., 100 times) the ratio between the communication cost 
term and the information gain term g(vj, v 2 , . . ., v T ). With such relatively large value, 
the communication cost is negligible compared to the information gain term, hence 
the optimization strongly favors the maximal information gain solution. 

[0032] If, furthermore, the information gain is additive, that is, 



g(Vi, v 2 , . . v T ) = g(vi) + g(v 2 ) + . . . + g(v T ) 



(2) 
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(as is the case if the inverse covariance matrix norm is used as the information gain 
metric), it is straight-forward to show that the total cost E is additive. Under the 
assumption set forth in Equation 2, the optimization of finding the best path from 
some initial leader node to any other nodes can be converted to the equivalent 
problem of finding the shortest path in a new graph G', which has the same set of 
vertices (nodes) and edges. The edge costs in G' are those in the original graph G 
modified by the information gain along each edge. In principle, simple Dijkstra's or 
Bellman-Ford type algorithms can be used to find such optimal paths. 

[0033] In practical sensor network systems, the information gain is often 
non-additive, and the problem of finding an optimal path is more complicated. In 
particular, the information gain is often dependent on the belief of the event of 
interest, and therefore, is history dependent. The cost of each edge is not a static 
value, but depends on the previously visited nodes. For such history dependent 
problems, standard shortest path algorithms are not applicable. Instead, the problem is 
combinatorial in nature. The possible sequences of visiting nodes may be enumerated 
and the best sequence may be selected. This approach is computationally formidable 
when the sensor network is large. Exemplary embodiments of the systems and 
methods according to this invention provide efficient suboptimal methods for path 
selection for some important scenarios in sensor network applications. 

[0034] Fig. 1 depicts a network with sensors, shown as dots with 
surrounding circles, and a querier node, shown as the darkly shaded circle, and 
illustrates an exemplary embodiment of a route query to relatively high activity 
network sensor regions and describes a scenario where the goal of routing is to route a 
query from an arbitrary querier node to the vicinity of a high activity region, such as, 
for example, the location of an event of interest like a target, and describes a method 
(min-hop algorithm) to find an information-directed path to fulfill this routing goal. 

[0035] In target tracking applications, it is often important to be able to 
initiate a query from some arbitrary entry point to find out the current status of the 
target. Ideally, the entry point node would like to contact the nodes in a high activity 
region, which presumably have a good estimate about the event of interest, such as 
target location. Due to the distributed nature of an ad hoc sensor network, the entry 
point may not be aware of the high activity region. Therefore, it is necessary for the 
entry point node to figure out which node in its local neighborhood may have better 
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information, and then relay the query to that node. During the relay, the intermediate 
nodes can incorporate their measurements to refine the target estimated, and in return, 
the refined estimate further improves the relay. This problem may be considered as a 
dual of the sensor selection problem in target tracking. The current leader node needs 
to decide which nodes among its neighborhood have the measurement which could 
help the most in terms of refining the target location estimate. 

[0036] In the exemplary embodiments, a computationally efficient 
algorithm, which is designated as a "min-hop" algorithm is used to solve the 
aforementioned query routing problem. The algorithm first selects the destination 
node by computing the utility of all the nodes it is aware of and selecting the node 
with the highest individual utility as the destination node. The letter m is used to 
designate the minimum number of hops required in order to reach the destination from 
a current leader. The algorithm then considers all possible paths of m hops or less 
from the source, which is the current leader node, to the destination node, and selects 
the path that traverses nodes with the greatest sum of information utility. This implies 
that the communication cost of each link in the graph, for example, measured by hop 
counts, is equal. The leader node then selects the first node in this path and passes 
the leadership to it. This algorithm may be performed at each time step and can be 
expressed as follows: 

1) Identify node with highest utility (i.e., information gain). 

2) Consider all the min-hop paths to that node. 

3) Select the path among min-hop paths that provides greatest total utility. 

[0037] Conveniently, various exemplary embodiments of the systems and 
methods according to this invention provide a short-cut for finding the minimum hop 
path to a destination node that maximizes the utility acquired along the path. The 
method is based on the observation that if a very large positive value is added to the 
cost of every link in the graph, then running a shortest path algorithm, such as 
Dijkstra's algorithm or the Bellman-Ford algorithm, will result in discovering the best 
among the minimum hop paths from the source node to each destination node. For a 
discussion of Dijkstra's shortest path algorithm, refer to A. S. Tanenbaum, Computer 
Networks, 3.sup.rd ed. Prentice-Hall, Inc., (1996), sec. 5.2.2. The Bellman-Ford 
algorithm is a shortest path on a weighted graph algorithm taught by D. P. Bertsekas 
in Dynamic Programming: Deterministic and Stochastic Models, pages 318-322, 
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Prentice-Hall, 1987, Englewood Cliffs, N.J., and D. P. Bertsekas and R. Gallager in 
Data Networks, pages 315-332, Prentice-Hall, 1987, Englewood Cliffs, NJ. 

[0038] The asymptotic computational complexity of the "min-hop fl 
algorithm is the same as the complexity of the shortest path algorithm used in time 
step three, described above. When Dijkstra's algorithm is used, that complexity is 
0(N log N+E) where N is the total number of nodes in the graph. 

[0039] The m-step look-ahead is often useful when the sensor network has 
some inhomogeneity, such as the presence of sensor holes. Incapable of seeking 
further beyond the immediate neighborhood, greedy algorithms such as CADR or 
IDSQ often get stuck at sensor holes because the best choice for the time being may 
be a dead end in the sensor holes. The m-step look-ahead scheme allow the min-hop 
algorithm to plan around the sensor holes, and, as a result, the exemplary 
embodiments of the systems and methods of this invention which utilize the min-hop 
algorithm outperform CADR and IDSQ significantly in terms of routing cost and 
estimation performance. 

[0040] Fig. 4 shows a flowchart which outlines an exemplary embodiment 
of a method according to this invention, for example, as discussed above. In step 
SI 000 the process begins. Control then moves to step SI 010, where an ad hoc sensor 
network is defined and established. 

[0041] Control then moves to step SI 020, where a query entry point in the 
sensor network is determined/selected. Control then proceeds to step SI 030, where 
the min-hop algorithm starts by selecting the querier node as the leader node. 

[0042] Control then proceeds to step SI 040, where a neighborhood around 
the current leader sensor is established. The neighborhood contains all nodes within 
m-hops of the current leader. Control then proceeds to step SI 050, where the utility 
(information gain) is evaluated for each node in the neighborhood. The node with 
highest utility value is identified as the destination point (we denote as N). Control 
then proceeds to SI 060, where the min-hop (shortest) paths from the leader to the 
destination N are computed. Such path may not be unique. If the min-hop paths are 
non-unique, the path with maximum utility/information gain is selected. We denote 
the path as P. 

[0043] Control then proceeds to step SI 070, where the leader refines the 
target estimates by incorporating sensor measurements. Control then moves to step 
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SI 080, where the next leader is selected as the first node along the selected path P. 
Steps SI 040 to SI 080 complete a path-planning iteration, and the query is relayed 
closer to the high-activity region. 

[0044] Control then proceeds to SI 090, where a determination is made so as 
to whether the path-planning has finished (according to a certain criterion, such as is 
the information good enough, or is the path exceeding some pre-set length). If so, 
control proceeds to SI 100, where the process ends. Otherwise, control returns to step 
SI 040, and the query relay continues. 

[0045] Fig. 2 illustrates one exemplary embodiment of a point-to-point 
routing from a querier (entry) node to a destination (exit) node, where the darkened 
circle is the querier node, the lightly shaded circles represent network sensor nodes, 
and the darkened circle with the larger circle around it is the exit node. This 
exemplary embodiment of the systems and methods of the invention describes a 
scenario where the goal of routing is to route a query from an arbitrary querier node to 
an arbitrary exit node (point-to-point routing), and proposed a method (RTA* forward 
search) to fulfill this routing goal. 

[0046] In this exemplary embodiment according to the principles of this 
invention, in the situation where a user issues a query from an entry point and wishes 
to extract the information from another point, called the exit point, in the sensor 
network, the goal of the user is to route the packet from the query node to the exit 
node within some specified amount of time and accumulate as much information 
about the target's position along the way in order to have the best possible estimate of 
the target position available at the exit node. This exemplary routing scenario 
embodiment may arise, for example, if a user, for example a police officer, located at 
an entry point (sensor node), issues a query, asking the sensor network to collect 
information and report to an exit point (sensor node) located, for example, at a police 
station, where communicated information can be extracted and utilized. 

[0047] In this specific exemplary embodiment, an A* type of forward search 
algorithm is suitable. A* is a best- first search, where the merit of a sensor node is 
assessed as the sum of the actual cost g paid to reach from the query node and the 
estimated cost h to pay to get to the exit node (often referred to as the "cost-to-go"). 
A* search keeps a moving frontier of g+h and iteratively expands the nodes on the 
frontier until the exit node is reached. A* search is described in detail, for example, in 
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"Real-time Heuristic Search", by R. Korf, which appeared in Artificial Intelligence, 
vol. 42, pp. 189-211, 1990, the subject matter of which is hereby incorporated herein 
by reference. 

[0048] For real time implementation, one may use a real-time A* (RTA*) 
algorithm. Given a start state (node) and a goal state (exit node), the RTA* algorithm 
computes the cost of reaching states that can be reached within M steps from the start 
state, and then uses a heuristic to estimate the remaining cost of reaching the goal state 
from each of those states. The method used according to this exemplary embodiment 
attempts to maximize the utility accumulated from visiting all the nodes along the 
path from the query node to the exit node subject to the constraints that the path can 
be traversed within some specified amount of path length. 

[0049] According to the various exemplary embodiments of the systems and 
methods of this invention, one way to implement the RTA* algorithm is to define a 
heuristic to estimate the cost of reaching the goal state from any given state, based on 
the relative positions of the start state and the goal state. In this case, the cost is the 
utility involved. In the exemplary embodiment considered here, the delay constraint 
imposes a limit on the length of a path that may be taken. Thus, the locus of all the 
possible paths forms an ellipse with the exit node as one focus point and the current 
node as the other. The utility that one may acquire on the path from a current node to 
the exit node is estimated to be equal to the utility of the corresponding ellipse. Fig. 3 
shows such an ellipse. There are infinitely many paths through the ellipse which 
satisfy the length constraint, and the path may be very complicated and hard to 
describe, such as the thin black line from the querier to the exit point in Fig. 3. 

[0050] Finding the optimal path and assigning its utility as the utility of the 
ellipse is difficult. The systems and methods according to this invention in one 
exemplary embodiment use an approximation approach. Using this approach, the 
ellipse is sampled with four candidate points is shown in Fig. 3, and the maximum 
utility among those four paths is used as the estimate of the utility of the ellipse. The 
four paths chosen are the ones consisting of two line segments, starting from the 
querier node, ending at the exit node, going through one of the four extreme points of 
the ellipse's minor axis or the major axis. To estimate the utility of a line segment, the 
systems and methods according to this invention in this exemplary embodiment 
assume that there are sensor nodes placed at a distance of A from each other along the 
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line segment. The utility of the segment is estimated to be the sum of the utilities of 
those hypothetical nodes along the line. 

[0051] The estimation of communication cost from the current node to the 
exit node is straight forward. One can use a standard metric such as Euclidean 
distance. This also corresponds to the number of hops when the sensor network is 
dense. Given the estimate of the communication cost and the estimate of information 
gained, the RTA* algorithm is straight forward. At step t, the active node grows the 
tree to a fixed finite depth and computes the sum of the already-encountered cost and 
the estimated cost to follow. The node with the lowest sum wins. The algorithm then 
repeats its self until reaching the exit node. 

[0052] The estimation of information contribution is summarized in Table 1 
and some parameters set forth in Table 1 are shown in Fig. 3. In Fig. 3, Node v^n is 
the exit sensor node. 

[0053] If the remaining path length allowance C t - C P (t) is smaller that the 
Euclidian distance between v, to v^-,, the ellipse cannot be constructed. In such a 
situation, the estimation algorithm set forth in Table 1 returns no (i.e., zero) 
information. At this point, the forward search degenerates into a shortest-path 
problem based on the communication cost alone. Moreover, if the initial allowance 
Co is zero to start with, then the algorithm returns the shortest path from the querier to 
the exit. 

[0054] An implementation of this algorithm has been achieved and its 
performance has been compared to a shortest-path algorithm which only considers the 
communication cost. Allowing the total length to be within twice the length of the 
shortest path, the estimation accuracy is improved greatly. The mean-squared error 
(MSE) decreased by a factor of 5 to 7. 

[0055] The min-hop and the forward-search algorithm require each node to 
be aware of its local neighborhood, and do not require any node to have complete 
knowledge about the network. Hence, the algorithm can be distributed and is scalable 
to large networks. 

[0056] Fig. 5 shows a flowchart which outlines the point-to-point routing 
using a forward search according to the various exemplary embodiments of the 
systems and methods of this invention, as set forth above. Control starts in step 
S2000, and proceeds to step S2010, where the ad hoc sensor network is defined. 
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Control then moves to step S2020, where the querier node and the extraction node are 
designated. They can be any arbitrary node in the sensor network. 

[0057] Control then proceeds to S2030, where the forward search starts by 
selecting the querier node as the first leader node. Control then proceeds to step 
S2040, where a neighborhood around the current leader node is established. It 
contains sensor nodes within m-hops to the leader. Control then proceeds to step 
S2050, where the costs for forward search are evaluated. For each neighboring node, 
an already paid cost g and a cost-to-go h are calculated. They both involve 
communication expense and information gain. 

[0058] In this regard, cost-to-go h may be determined as discussed above. 
Control then proceeds to step S2060, where the neighboring nodes are compared of 
their overall merit g+h. The node with the smallest g+h value is considered as the 
best move and selected as the leader for the next time step. The leader then refines 
target estimates by incorporating sensor measurements. Steps S2040 to S2060 
complete an iteration, where the forward search advances by length 1 . 

[0059] Control then moves to S2070, where the test as to whether the path- 
planning is finished is performed. The path-planning is finished if the extraction node 
is reached. If so, the system terminates. Otherwise, control returns to S2040, and 
forward search continues. 

[0060] In the aforementioned exemplary embodiments of the systems and 
methods of this invention, the problem discussed is in a target localization framework. 
The idea of information directed routing is a rather general idea, and the formulation 
of the systems and methods according to the invention is in terms of information 
gained, which applies to many applications. For example, in target tracking 
embodiments, the applicable applications include 1) detection where the target state is 
discrete, i.e., "zero" when the target is not present and "one" if the target is present); 2) 
localization, where the target state is the target location; and 3) classification, where 
the target state is the target type, such as, for example a tank, a car, an airplane, etc. 

[0061] Simulations were carried out to validate and characterize the 
performance of exemplary embodiments of the systems and methods of this invention. 
A simulation of a sensor field with dimensions of 225 x 375 square meters was made. 
This simulation involved two types of sensors for target tracking: acoustic amplitude 
sensors and direction-of-arrival (DOA) sensors. As pointed out above, other types of 
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sensors could have been used. The output sound amplitude of the amplitude sensors 
was measured at each microphone, and an estimate was made of the distance to a 
target based on the physics of sound attenuation. The direction of arrival sensors were 
relatively small microphone arrays. Using conventional beam forming techniques, the 
direction where the sound comes from, that is the bearing of the target, was 
determined. 

[0062] The sensor network layout was generated in the following manner. 
First, a uniform grid of 15 rows and 6 columns was generated to evenly cover the 
region. Then, the grid points were perturbed with independent Gaussian noise of N 
(0, 25). The resulting sensor layout is shown in Fig. 6. To test the routing 
performance in the presence of sensor holes, the uniform grid points (sensor nodes) in 
rows 5 and 6 in columns 2-5 were removed before adding perturbation. The resulting 
sensor network is shown in Fig. 7. The sensor network consists of approximately 70 
percent amplitude sensors which are spread over the sensor region. Each sensor was 
able to directly communicate to neighbors within about a 50 meter radius. 

[0063] The routing processes or algorithms were evaluated in terms of the 
efficiency of communication expenditure, and the effectiveness of information 
aggregation in support of target tracking. Tracking performance was measured using 
mean square error (MSE) and belief size. Attention was also paid to noticeable 
features, such as, for example, whether the path from insertion point to extraction 
point successfully gets around holes, where the path ends, and how the path detours to 
accumulate information. 

[0064] The simulation results for routing a query from an arbitrary query 
proxy node to an extraction node in a relatively high information content region using 
an min-hop algorithm is as follows: 

[0065] In the case of a stationary target, the stationary target is simulated at 
location (125, 200). The sensor closest to the lower left corner (0, 0) was used as the 
query proxy node. Starting from the proxy node, the target location was progressively 
estimated and the query directed towards it. In the simulation, a path length of 20 
hops was permitted, and the performance was examined at the end of the path. The 
sensor network was inhomogeneous with a sensor hole, as shown in Fig. 7. 

[0066] For this routing task, the min-hop algorithm was compared using a 
look ahead horizon M = 2, 3 and 4 with the greedy CADR algorithm. Each method 
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was simulated with 100 independent runs. The results of those 100 runs are 
summarized in Table 2. Some paths got stuck and failed to route around the sensor 
hole. Paths having an ending point with a Y coordinate below 100, were considered 
as "stuck" situations. 

[0067] Compared to the greedy CADR algorithm, the min-hop algorithm 
significantly improved the tracking performance. For example, with a three step look 
ahead, the min-hop algorithm successfully routed around the sensor hole in 92 runs, 
whereas only 8 runs become stuck at the sensor hole. By contrast, the CADR 
algorithm failed in 80 runs. Tracking performance was also improved with the min- 
hop algorithm. For example, with M = 3, the min-hop algorithm reduced the square 
root of MSE by a factor of four, and reduced the belief size by a factor of three. The 
tracking performance comparison suggests that the min-hop algorithm aggregates 
information more effectively than the greedy CADR algorithm. 

[0068] Table 2 lists the average distance between the path ending point and 
the true target. This distance indicates the capability of the routing algorithm to route 
a path to the vicinity of the target. The greedy CADR algorithm performed poorly 
here. For example, the ending point was, on the average, very far, for example, 
108.91 meters, from the true target location. The min-hop algorithm routed the path 
to much closer positions. For example, with M = 3, the ending point was 
approximately 33 meters from the target. 

[0069] In general, overall performance is seen to improve with an increase 
of the look ahead horizon M, but the improvement is non-uniform. The improvement 
is most prominent for small values of M, and is marginal as M increases. In view of 
these observations, one may select a value of M based on knowledge of network 
inhomogeneity, such as for example, sensor hole size. In our simulated sensor layout, 
a three hop path is often sufficient to get to the side of a sensor hole and further 
diverge around it. Further increasing M to four appears to bring little gain and 
performance. 

[0070] Fig. 8 shows a query routing path produced by the greedy CADR 
algorithm. Fig. 9 shows a query routing path produced by the min-hop algorithm with 
M = 3. The target is located at (125, 200), which is roughly in the middle of the 
sensor field. Both Figs. 8 and 9 show the target and the selected paths, and the nodes 
where the path ends. Referring to Fig. 8, it is noted that the path got stuck and spent 
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most of its hops, 17 hops out of 20, bouncing between two nodes on the lower side of 
the sensor hole. The ending point was far away from the target. For comparison, the 
min-hop path plotted in Fig. 9 is shown to have managed to get around the sensor hole 
and stops at a node slightly above the true target location. The tracking performance 
is also improved relative to that shown in Fig. 8. In other words, the target location 
estimate for the min-hop algorithm is more accurate and has a higher confidence than 
the target location estimate based on the greedy CADR algorithm. 

[0071] In tracking applications, the target is often not stationary. 
Accordingly, the simulations deal with a moving target. A moving target may be 
considered as an extension of the stationary target case, and the target may be 
considered as approximately stationary within a short time interval. With a moving 
target, routing a query towards the high information content region is essentially 
achieved by routing a path to follow the target. In the simulation, a target is assumed 
to be moving along the straight line X = 125 (that is the centerline of the sensor field 
along the vertical dimension) with a speed of 7 meters per second. The query entered 
at the node closest to the initial target position (125, 0). Applicants compare the min- 
hop algorithm (M = 2, 3 and 4) with the greedy CADR, with 100 independent runs for 
each algorithm. The performance is summarized in Table 3. As in the stationary case, 
routing algorithms may get stuck at sensor holes. While a routing is stuck, the target 
estimate typically is expected to keep worsening due to weaker signals. In our 
simulation, a track was considered lost if, by the time the vehicle reached the upper 
side of the sensor field (Y = 375), the estimate of target location of the last five steps 
was on average more than 60 meters away from the true target location. 

[0072] We report the number of "lost" runs, and the statistics (MSE and 
belief size) for the good runs, averaged over all 100 runs and all time steps. We 
observed similar characteristics as in the stationary case. With the greedy algorithm, 
most of the runs lost the target, that is 93 out of 100 runs lost the target. With 
increasing look ahead horizon M, the percentage of lost runs was reduced significant. 
Among the good runs, the tracking performance improved as M increases. For 
example, with M = 3, the square root of the MSE was only one-half of that obtained 
by the greedy algorithm. From these results, we can conclude that the min-hop 
algorithm with a modest look ahead horizon (M = 2 or 3) is much more robust than 
the greedy CADR algorithm in the presence of sensor holes. 
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[0073] Figs. 10, 1 1 and 12 show several snapshots of the routing path using 
the greedy algorithm. In all runs, the final path was 100-hop long. Figs. 10, 1 1 and 
12 show the progressive path development after 30, 60 and 90 hops. As in the 
stationary target situation, the min-hop algorithm routed around sensor holes. The 
snapshots indicate that the path mainly followed target movement, but occasionally 
reached out to nearby sensors to aggregate information. The belief states, i.e., states 
of belief about target location, appear to have followed the target fairly closely. For 
comparison, the path produced by the greedy CADR is plotted in Figs. 13, 14 and 15. 
As shown in Figs. 13, 14 and 15, the path produced by the greedy CADR algorithm 
failed to get around the sensor hole within 30 hops and was stuck ever since. The 
belief state failed to track the target. As the target moved away, the signal apparently 
became too weak to correct a belief. Accordingly, the belief about target location 
eventually missed the target completely. This failure appears to have been caused by 
the feedback between belief estimation and query routing. In other words, as the 
routing failed to aggregate information, the estimate appears to have become poor. 
Also, as the estimation accuracy deteriorated, the estimated belief state about target 
location appears to have provided little guidance to routing. 

[0074] Applicants tested the query routing using a forward search algorithm 
from the query proxy to the exit node using a stationary target at (125, 200). It is 
noted that the selection of the query proxy and the exit node may be arbitrary. 
Applicants selected the query proxy node as the node closest to the lower left corner 
(0, 0), and the exit node was selected as the node closest to the upper left corner (0, 
375). Forward search was performed on a homogeneous sensor network, as in Fig. 6, 
to route the query between those two nodes. 

[0075] As pointed out above, the information-directed routing problem is 
essentially a trade off between the communication expense and information 
aggregation, with the balance controlled by the hypothetical path link constraint Co- 
The simulation varied the allowance Co- For each value Co, 100 independent runs 
were simulated. The numerical results are listed in Table 4. The simulations used the 
shortest path as a benchmark for comparison. In this regard, reference is made to the 
left most point in Fig. 6. The average number of hops is seen to increase with the 
hypothetical allowance Co. The average number of hops is the same order as Co 
divided by the radio range of 50 meters, but about from 35-50 percent larger. This 
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margin accounts for the fact that sensors are not dense enough, in many instances, and 
communication over maximum radio range may not always be feasible. From 
Table 4, one can see that both the MSE and the belief size decreases with path length. 
Compared to the shortest path, the information-directed routes took a little bit of a 
detour, but improved the tracking performance considerably. On the average, the 
square root of MSE was cut in half. 

[0076] Figs. 16, 17 and 18 show selected paths with different lengths. The 
shortest path is shown in Fig. 16 and has 10 hops and mostly follows a vertical line 
from the query proxy to the exit node. The belief state is fairly large, and cannot 
localize the target. Fig. 1 7 shows a longer path of 12 hops. Starting from the proxy 
the path bends towards the target direction in an attempt to accumulate information. 
The tracking performance is vastly better for the longer than the shorter path. Fig. 1 8 
shows a path of 21 hops. The tracking accuracy for this third path is further improved, 
but the improvement is less prominent. With respect to Fig. 16, that shows the 
shortest path of 10 hops, the square root of MSE is 43.18 and the belief size is 1 176. 
With respect to Fig. 17, that is the 12 hop path selected by the RTA* algorithm, the 
square root of (MSE) equals 3.70, and the belief size is 91. With respect to Fig. 18, 
that is the 21 hop path selected by the RTA* algorithm, the square root of MSE is 
2.46, and the belief size is 105. 

[0077] In the simulations disclosed above, the min-hop algorithm is shown 
when compared to the previous greedy algorithm, to be from four to 1 1 times more 
likely to succeed in routing a message around sensor holes with a three step look 
ahead, and at the same time produce two to four times less error in tracking a signal 
source. 

[0078] While the invention has been described in conjunction with the 
exemplary embodiments outlined above, it is evident that many alternatives, 
modifications, and variations will be apparent to those skilled in the art. Accordingly, 
the exemplary embodiments of the invention, is set forth above are intended to be 
illustrative and not limiting. Various changes may be made without departing from 
the spirit and scope of the invention. 



